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(54) Method of recording material data of broadcasting programs and displaying the content of 
the data, and system for executing the method, and recording medium recording a procedure 
of implementing the method 



(57) A method of recording material data of a broad- 
casting program and displaying its content includes the 
steps of storing data of a plurality of program materials 
each having an identification code allotted thereto in a 
first memory device (5) (steps 104 to 108), extracting 
one or a plurality of image data representative of the 
material from the image data of the material for each of 
the program materials (steps 1 1 0 to 11 3), arranging data 
of the representative images of each of the program ma- 
terials in association with the identification code in the 
sequence of a broadcasting time and storing the data in 
a second memory device (8) (step 114), and reading out 
the data of the representative images of the program 
material from the second memory device (8) on the ba- 
sis of the identification code and displaying the data by 
a display (step 1 1 9). A system for recording materials of 
a broadcasting program and displaying its content in- 
cludes recording/reproduction apparatuses (1, 2, 3) for 
recording and reproducing the broadcasting program 
materials, a control unit (6) for processing information 
inputted in accordance with a control program and con- 
trolling the operation of the system as a whole, an input 
unit (11) for inputting the information of broadcasting 
programs inclusive of the information of a broadcasting 
time of each program to the control unit, a display (7) for 
displaying the data outputted from the control unit on a 
screen, a first memory device (5) for storing image data 
reproduced by the recording/reproduction apparatuses, 
and a second memory device (8) for storing the data 
outputted from the control means, wherein the control 
unit (6) includes a unit for allotting identification codes 



to a plurality of program materials, and a unit for extract- 
ing the data of representative images of each program 
material from the image data of the program materials 
for each program material, and the control unit outputs 
the data of the representative images of each of the pro- 
gram materials in association with the identification 
code to the first memory device, reads out the data of 
the representative image of the program material on the 
basis of the identification code from the first memory de- 
vice, and outputs the representative image to the dis- 
play A recording medium stores a procedure for imple- 
menting the method of recording material data of broad- 
casting programs and displaying the content 
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Description 

This invention relates to a system which directly 
reads out material data such as image data from a ran- 
dom access type memory device storing the image data s 
in a succession quite unrelated a series of broadcasting 
sequences, and uses the image data for broadcasting. 
More particularly, this invention relates to a method 
which makes it possible to visually confirm whether or 
not a broadcasting sequence is appropriate or whether 10 
or not image signals, etc, are appropriately stored in the 
memory device described above, by using still image 
information of program materials, and to a system for 
executing such a method. 

Program broadcasting equipment which stores im- is 
age signals, etc, for each program material by using a 
random-accessible memory device such as a video 
disk, a semiconductor memory, or the like, reproduces 
the image data such as image signals from the memory 
device in a well-timed manner for an edited sequence 20 
of a program, and records the image data such as image 
signals in another memory medium such as a video tape 
called an "unified tape", has been employed in recent 
years. Here, the term "unified tape" means a video tape 
recording thereon each program material with editorial 25 
order in accordance with the broadcasting sequence. To 
confirm the edited content of the program in such a mov- 
ing picture editing equipment at the time of the edition 
work, a method is known which extracts a representa- 
tive frame image of each cut from image signals of dy- 30 
namic images stored in each cut unit, and displays a list 
of the extracted representative frame images. An editor 
corrects information of a reproduction sequence of each 
cut while watching the list displayed on the moving pic- 
ture editing apparatus. For Example, Japanese Patent 35 
Application Laid-open No. JP-A-4-1 17686 discloses an 
invention entitled "Moving Picture Editing Apparatus". 

When recorded programs are broadcasted, the 
broadcasting sequence of the programs generally are 
extremely important and if any error occurs in the se- 40 
quence of the programs so broadcasted, the influences 
of such an error on the broadcasting station are unfath- 
omable. According to the prior art method, therefore, a 
unified tape is generated above all. This unified tape is 
generally previewed before broadcasting of the pro- 45 
grams so as to confirm whether or not the sequence of 
the recorded programs is correct and whether or not any 
quality problem exists in the images of the reproduced 
programs. Thereafter, the image signals, etc, repro- 
duced from the unified tape so confirmed is broadcasted so 
at the time of program broadcasting. 

In the method of broadcasting the programs accord- 
ing to the prior art described above, the still images are 
arranged and displayed on the basis of reproduction se- 
quence information which is edited, at the time of the ss 
edition work of editing the programs before the unified 
tape is produced, and the editor can easily confirm or 
preview the edition result and quality of the image sig- 



nals stored in the random access type memory device. 
However, in order to re-confirm the sequence of the pro- 
grams edited into the unified tape and the contents of 
the programs after the reproduction sequence informa- 
tion is edited and the unified tape is produced but before 
the start of broadcasting of the programs, or to confirm 
image quality of the programs reproduced from the uni- 
fied tape, the confirmation items described above must 
be checked for each reproduced image with eye watch- 
ing while the unified tape is being reproduced, and an 
extremely long time is necessary. 

Furthermore, the unified tape cannot be produced 
unless all the necessary program materials are stored 
into the memory device. 

It is therefore an object of the present invention to 
make it possible to confirm the broadcasting sequence 
of a series of programs and the contents of representa- 
tive still images of the programs without producing an 
unified tape by integrating program reproduction se- 
quence information so that it can be used at the time of 
confirmation of the edition content and at the time of 
broadcasting. 

It is another object of the present invention to elim- 
inate confirmation of quality of all the images of the uni- 
fied tape and to remove an elongated tape reproduction 
time that has been necessary in the past for confirma- 
tion. 

It is still another object of the present invention to 
make a confirmation work of a program broadcasting se- 
quence before, and during, broadcasting of the pro- 
grams easy. 

It is still another object of the present invention to 
confirm any omission of those programs which are listed 
up in a reproduction sequence information but have still 
to be stored in a video server, by the absence of still 
images displayed. 

A method of recording material data of a broadcast- 
ing program and displaying its content according to the 
present invention comprises the steps of storing data of 
a plurality of program materials each having an identifi- 
cation code allotted thereto in a first memory device, ex- 
tracting one or a plurality of image data representative 
of the program material from the image data of the ma- . 
terial data for each of the program materials, arranging 
data of the extracted representative images of each of 
the program materials in association with the identifica- 
tion code of corresponding material in the sequence of 
a broadcasting and storing the data in a second memory 
device, and reading out the data of the representative 
images of the program material from the second mem- 
ory device on the basis of the identification code and 
displaying the data by a display device. 

Further, a system for recording materials of a broad- 
casting program and displaying its content comprises 
recording/reproduction apparatuses for recording and 
reproducing the broadcasting program materials, a con- 
trol unit for processing various kinds of information in- 
putted in accordance with a predetermined control pro- 
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gram and controlling the operation of the system as a 
whole, an input unit for inputting the information of 
broadcasting programs inclusive of the information of a 
broadcasting time of each program to the control unit, a 
display for displaying the data outputted from th e control s 
unit, a first memory device for storing the image data 
outputted trom the recording/reproduction apparatus, 
and a second memory device for storing data repro- 
duced by the control unit, wherein the control unit in- 
cludes a unit for allotting identification codes to a plural- 
ity of program material, and a unit for extracting the data 
of representative images of each program material from 
the image data of the program materials for each pro- 
gram material, and the control unit outputs the data of 
the representative images of each of the program ma- 
terials in association with the identification code to the 
second memory device, reads out the data of the rep- 
resentative image of the program material on the basis 
of the identification code from the second memory de- 
vice, and outputs the representative image to the dis- 
play. 

According to the embodiment of the present inven- 
tion, in the first place the program materials recorded on 
a memory medium such as a video tape are stored in a 
memory device capable of reading them by a random 
access system, such as a video disk of a video server 
or the like. At this time, the memory address of each 
program material to be stored in the video disk is stored 
in association with the material number (identification 
code) of the program materials. 

When, or after, the program materials are stored, 
the change of the scene of the image signals is detected 
for each program material on the basis of the image sig- 
nals reproduced from the video disk. Each scene is then 
divided on the basis of the change which is the detection 
result, and one still image representative of the image 
content of each divided scene is selected for each 
scene. When one representative image is selected in 
this way, the image information of the still image that 
represents each selected scene is stored as the infor- 
mation corresponding to the image for each program 
material in order to display one image representing the 
image content instead of reproducing alt the image sig- 
nals stored in the video disk. At this time, the image in- 
formation of the still image for each program material is 
stored in association with the material number of the 
program material and with the scene sequence number 
for each material. 

To make it possible to confirm transition of the con- 
tent of the scene for each image from the image infor- 
mation of the still image so stored, the still image repre- 
sentative of each scene is aligned and displayed on one 
screen in the sequence corresponding to the scene se- 
quence number of each scene for each scene. Each 
program material has naturally different scenes from an- 
other, and has in many cases similar or exactly the same 
scene. Therefore, the contents of the program materials 
can be confirmed extremely easily by displaying in the 



list form the still images representative of the image con- 
tents of the respective scenes for each program mate- 
rial. 

According to another embodiment of the present in- 
vention, one still image information among the still im- 
age information for each image signal displayed on the 
one screen is set as the representative still image infor- 
mation for representing each image signal. The repre- 
sentative still image information set in this way and the 
representative still information of each image signal in 
accordance with the broadcasting sequence are aligned 
and displayed. The representative still image is so set 
as to represent the content of one characterizing scene 
in the image signals for each program material, and 
these representative still images are aligned and dis- 
played in accordance with the broadcasting sequence. 
In this way, whether or not any broadcasting problem as 
to the broadcasting sequence of the program materials 
can be confirmed. At the same time, those program ma- 
terials which are listed up in the broadcasting sequence 
information and are not yet stored in the video disk can 
be confirmed extremely easily because their still image 
information are not stored and hence, are not displayed, 
either. 

According to the method of the present invention, 
further, a plurality of still images aligned in the sequence 
corresponding to the sequence of each scene for each 
image signal are realigned in the sequence correspond- 
ing to a predetermined broadcasting sequence and are 
displayed on the monitor on the basis of a plurality of 
still image information for each image signal stored and 
the broadcasting sequence information stored previous- 
ly. According to this arrangement, it becomes possible 
to confirm those problems in the broadcasting sequence 
among the program materials which cannot be detected 
by the method described above, that merely aligns and 
displays the representative still images, such as when 
the broadcasting sequence becomes the problem by the 
comparison of a scene with another, or when the content 
of a scene not representing the subject matter of a pro- 
gram material and not set as the representative scene 
renders the problem of the broadcasting sequence. 

According to the method of the present invention, 
further, when a plurality of image signals stored are be- 
ing broadcasted in a predetermined broadcasting se- 
quence, the representative still image having a subse- 
quent broadcasting sequence from the image signal that 
are now on-air and corresponding to the image signals 
not yet broadcasted is displayed. In the case of an emer- 
gent change of a program, etc, therefore, the program 
material to be broadcasted in succession to the program 
material which is now on-air can be confirmed. 

Furthermore, the present invention provides a re- 
cording medium which stores a procedure for recording 
aforementioned material data of broadcasting programs 
and displaying the contents of the data. The procedure 
used for computer-aided control of the system imple- 
menting aforementioned method of the present inven- 
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tion can be read out suitably from this recording medi- 
um. A method of aforementioned procedure also can be 
recorded in this recording medium in conformity with 
various configuration. 
In the drawings 

Fig. 1 shows an example of a display screen for dis- 
playing altogether a list of information on broadcast- 
ing programs and representative images of pro- 
gram materials on one screen; 
Fig. 2 shows an example of a display screen for dis- 
playing images of representative scenes in one pro- 
gram in the sequence of a broadcasting; 
Fig. 3 shows an example of a display screen for dis- 
playing representative images representative of a 
plurality of broadcasting programs in the sequence 
of a broadcasting; 

Fig. 4 shows an example of a display screen for dis- 
playing representative scenes of a plurality of 
broadcasting programs in the sequence of a broad- 
casting; 

Fig. 5 is a block diagram of a system for recording 
materials of a broadcasting program under the as- 
sistance of a computer and displaying the content 
according to the present invention; 
Fig. 6 shows an example of a display screen for dis- 
playing a list of information on a broadcasting pro- 
gram; 

Fig. 7 is a flowchart of a method of recording mate- 
rials of a broadcasting program under the assist- 
ance of a computer and displaying the content ac- 
cording to the present invention; 
Fig. 8 shows an example of a display screen of a 
list of information on program materials of an exter- 
nal input information; and 

Fig. 9 shows an example of registered information 
screen of materials of commercial message imag- 
es. 

Hereinafter, embodiments of the present invention 
will be explained in detail with reference to the accom- 
panying drawings. 

Fig. 5 is a block diagram showing an example of a 
system for recording materials of a broadcasting pro- 
gram under the assistance of a computer and displaying 
their contents. 

In Fig. 5, reference numerals 1, 2 and 3 denote 
means for reproducing image signals from a recording 
medium recording thereon program materials, such as 
video tape recorder (VTR). Reference numeral 4 de- 
notes a switcher to which the image signals from the 
VTRs 1 to 3 are inputted and which selectively outputs 
one of these image signals. Reference numeral 5 de- 
notes a recording unit (video server) capable of record- 
ing and reproducing the image signals and sound sig- 
nals by a random access system, and it comprises a 
magnetic disk, for example. Reference numeral 6 de- 
notes a controller which controls each part of the pro- 



gram broadcasting system and to which input informa- 
tion 10 is inputted from outside. Reference numeral 7 
denotes a display device for displaying various informa- 
tion from the controller 6, reference numeral 8 denotes 
5 a memory device for storing the control information and 
the input information used by the controller 6, and ref- 
erence numeral 9 denotes a display for displaying the 
images by the image signals and the sound signals from 
the video server 5. Reference numeral 11 denotes a 
keyboard through which an operator applies command 
information to the controller 6. 

The controller 6 includes a memory (not shown) 
storing therein a control program, a central processing 
unit 8 (not shown) and another memory (not shown) ca- 
pable of temporarily storing the input information and 
outputting it. The controller 6 controls the operations of 
peripheral devices connected thereto in accordance 
with the control program, and further processes the in- 
put information and outputs the result. The controller 6 
stores the control program of the flowchart of Fig. 7 
which will be later described in detail, for example, and 
functions in such a manner that the operation described 
by the flowchart can be executed. 

The external input information 10 inputted from out- 
side to the controller 6 is outputted from the controller 6 
and is inputted to the memory device 8. This external 
input information 10 is the information for each program 
material such as (1) a program time representing the 
broadcasting time of the program, (2) a material number, 
(3) a program sponsor, (4) a program content describing 
the content of the program, and so forth. As an example 
of the information for each program, the information 
such as the program time, the material number, the pro- 
gram sponsor and the program content as represented 
by 00:30, 000006, OD company and the drama n ABC M 
as represented by marking 23 in Fig. 1 , are stored. The 
program broadcasting list, for example, is inputted as a 
program broadcasting sequence information. In this 
program broadcasting list, there is the case where a se- 
ries of a program group aligned in accordance with the 
broadcasting sequence are handled dividedly as broad- 
casting program gatherings. Hereinafter, this broadcast- 
ing program gathering will be simply called the "program 
gathering". 

The information contained in the program broad- 
casting list inputted to the controller 6 include, for exam- 
ple, (5) a program gathering time at which broadcasting 
of the program gathering is started, (6) a program gath- 
ering sequence representing the broadcasting se- 
quence of the program gathering, (7) a program gather- 
ing period representing the broadcasting time period of 
the program gathering, (8) a program gathering ID for 
identifying each program gathering and (9) a material 
number of a program broadcasted for each program 
gathering, and these informations are listed up in the 
broadcasting sequence for each program gathering. 

On the other hand, the program materials recorded 
on the video tape are reproduced by any of the VTRs 1 



15 



20 



25 



30 



35 



40 



45 



SO 



7 



EP 0 774 756 A2 



8 



to 3. The image signals so reproduced are inputted to 
the video server 5 and to the controller 6 through the 
switcher 4. At this time, the operator inputs the identifi- 
cation number corresponding to the reproduced pro- 
gram material, such as the material number, with tap- 
ping at the keyboard 11 to the controller 6. The video 
server 5 outputs to the controller 6 the memory address 
information representing at which place the image sig- 
nal is stored inside the video server 5. The controller 6 
relates the inputted materia! number with the memory 
address information and outputs this relation informa- 
tion to the memory device 8, and the memory device 8 
stores this information. 

The reproduced image of the program material sent 
from any of the VTRs 1 to 3 is inputted further to the 
controller 6 through the switcher 4. Each program ma- 
terial includes generally a plurality of scenes. In the case 
of a news program, for example, the program material 
includes the scene of the title at the start of the news 
program, the scene of an announcer as a news caster, 
the scene of the site of a certain happening, the scene 
of the live from field report of another news, and so forth. 
The controller 6 extracts the image in which the scene 
changes, from the reproduced images of the VTR. The 
extraction of the images in which the scene changes can 
be executed by using a technology entitled "Detection 
Method of Change Point of Moving Images" disclosed 
in Japanese Patent Application laid-open No. JP-A- 
4-111181 which detects the change point of scenes by 
searching a change ratio of a correlation coefficient of 
a feature quantity between adjacent frame images, for 
example. 

The program material can be divided into a plurality 
of scenes at a boundary between adjacent pictures in 
which the scene changes by more than a predetermined 
amount. The controller 6 selects a frame image (still im- 
age) representative of the image of each scene for a 
plurality of these scenes. Generally, the first frame im- 
age of each scene is selected as a representative still 
image. Extraction of a scene change picture and selec- 
tion of a representative scene are operated in accord- 
ance with the control program of the controller 6. 

The information quantity, for example, of the repre- 
sentative still image so selected is thinned out and the 
image information is data-compressed by the controller 
6 to reduce the information quantity. The still image in- 
formation compressed in this way is related with its ma- 
terial number for each program material, and is further 
related with the sequence information (scene sequence 
number) of the scene for each corresponding program 
material. Thereafter, this information is stored in the 
memory device 8. 

As a result of the operations described above, the 
images of the representative scenes of each program 
material are stored in the memory device 8, and all the 
program materials necessary for broadcasting are 
stored in the video server 5. 

Next, the operations of the system for recording the 



materials of the broadcasting programs and displaying 
their contents under the assistance of a computer, ex- 
plained above, will be explained in further detail with ref- 
erence to the flowchart of Fig. 7. 

s First, a start of the program material inputting work 
(registration operation) is set at the step 100. The input 
information 10 is inputted from outside to the controller 
6 at the step 101. The list tabulating the information 10 
regarding the inputted program materials in the se- 

10 quence of the broadcasting is displayed on the screen 
of display 7. In this list, the input information 10 is as- 
sorted in accordance with each program material and is 
displayed in the arrangement as shown in Fig. 6. The 
operator sets the pointer to the display position of the 

is desired program material in the list on the screen at the 
step 102. The operator sets the video cassette recording 
the program material, which is to be registered, to the 
VTR1 at the step 103 at which the program material to 
be registered is designated. The controller 6"Tjives a 

20 command to start the operation of the program material 
registration at the step 1 04. The switcher 4 connects the 
output of the VTR1 to the inputs of the controller 6 and 
the video server 5 at the step 105. The steps 106, 107 
and 108 are strated simultaneously. The controller 6 in- 

25 puts the reproduced images from the VTR1 at the step 
1 06. The reproduction operation of the video tape by the 
VTR1 is conducted at the step 107. The reproduced im- 
ages from the VTR1 are recorded by the video server 5 
at the step 108. Whether or not the program materials 

30 to be registered are all incorporated is checked by con- 
ducting counting up to the required time of the program 
at the step 109. The image in which the scene changes 
is extracted at the step 110 by using the method of de- 
tecting the change point of the moving images described 

35 jn JP-A-4-111181. That is, the extracted image has a 
scene change by more than a predetermined amount 
between adjacent pictures. Material numbers corre- 
sponding program materials are allotted to all the imag- 
es having the scene change and so extracted, as the 

40 representative still images, and these images are 
aligned in the sequence of the broadcasting and are 
temporarily stored in the memory inside the controller 6, 
at the step 111. The number of representative images 
of the scenes stored in the controller 6 (frame number) 

45 js counted up at each program material at the step 112. 
The subsequent steps 113, 114 and 115 are executed 
simultaneously. Namely, the controller 6 finishes the in- 
put operation of the reproduced images from the VTR1 
at the step 113. The video tape reproduction operation 

50 by the VTR1 stops at the step 1 1 4. The recording oper- 
ation to the video server 5 stops at the step 115. The 
representative still images are read out from the mem- 
ory of the controller 6 and are stored in the memory de- 
vice 8 at the step 116. One still image representative of 

55 the program is designated from among a plurality of rep- 
resentative still images. Generally, the typical image of 
the scene having the first scene change is designated 
as the representative image of the program. Further, the 



9 EP 0 774 756 A2 10 



number of representative still images to be registered is 
added to the input information 1 0 at the step 11 7. By the 
way, designation of the program representative image 
can be redesignated. The additional input information is 
inputted to the memory device 8 at the step 118. The 
registration operation of one program material is com- 
pleted by a series of operations described above. At this 
point, a display representing that registration is finished 
is applied to the program material registered, in the 
screen of the registered information list of the program 
material (see Fig. 9). When the program representative 
image is to be redesignated, a pointer is set to a button 
display 90 for the designation change of the represent- 
ative image of the screen shown in Fig. 9 so as to instruct 
the designation change. The scene representative im- 
ages of the program material registered to the memory 
device 8 are serially displayed at the upper right corner 
91 of the screen. When the desired still image is dis- 
played at this upper right corner 91 , the pointer is set to 
the registration button 92 so as to register the scene rep- 
resentative image as the program representative still im- 
age. 

Next, the operation of displaying the scene repre- 
sentative image of each program material registered 
and the program representative image on the display 
device 7 will be explained. The display screen shown in 
Fig. 6 is displayed at the step 119, and the kind of the 
program material and the display image to be displayed 
is designated by the pointer 82. For example, when the 
button 83 designated as "representative image screen" 
is designated, the screen of Fig. 1, which will be ex- 
plained below, is displayed, and when the button 84 des- 
ignated as "cut list", the screen shown in Fig. 4 is dis- 
played at the step 120, respectively. Further, the display 
screen of the list of the external input information shown 
in Fig. 8 is displayed, and when the button 85 designated 
as "registration" is pointed by the pointer 82, the screen 
shown in Fig. 2 is displayed. Further, the screen shown 
in Fig. 3 is displayed by designating the area of the gath- 
ering information of the screen in Fig. 6 as will be ex- 
plained later. In the screen shown in Fig. 3, the repre- 
sentative images of all the programs inside the program 
gathering are arranged and displayed in the sequence 
of the broadcasting. Incidentally, in the flowchart of Fig. 
7, the steps 1 1 8 and 119 are depicted as the continuous 
steps. However, the program material registration oper- 
ation of the steps 100 to 118 and the display operation 
of the program material information of the steps 1 1 9 and 
120 are mutually independent, and both operations 
need not be always conducted continuously. 

Next, the method of displaying whether or not qual- 
ity of the content of the program material so registered 
and its sequence of broadcasting are appropriate will be 
explained. 

First, the content of the program broadcasting list 
stored in the memory device 8 is altogether displayed 
as shown in Fig. 6. In this drawing, reference numeral 
80 denotes a display area for displaying a part of the 



program list. In the display area 80, the gathering time, 
the gathering sequence, the gathering ID, the program 
time, the material number, the program sponsor and the 
program content are aligned and are altogether dis- 
s played for each gathering and for each program mate- 
rial. The program content for each gathering can be 
switched to the display for confirmation by using the still 
image. This confirmation can be attained by selecting 
the display portion of the gathering information, which 
10 is displayed in the display area 80, of the gathering 
whose content is desired to be confirmed, by using the 
pointer. Then, the display is switched to the screen in 
which the still images are aligned as shown in Fig. 3. 
This drawing represents the case where a gathering 
15 having the gathering sequence of 02 and the gathering 
ID of 06022123 is selected, and the representative still 
images for each of the five programs inside the gather- 
ing are displayed. 

Because the present invention makes it possible to 
20 switch the screen display shown in Figs. 6 and 3, the 
present invention can quickly confirm the content of 
each program material, though the detail of the display 
content shown in Fig. 3 will be described later. Because 
the present invention makes it also possible to switch 
25 the display screen to the screen shown in the later-ap- 
pearing Fig. 2, which depicts an example of the display 
screen for displaying the representative images of the 
scenes of each program material in the broadcasting se- 
quence, besides the screen display shown in Fig. 3, it 
30 becomes possible to monitor in more detail the relation- 
ship between the program broadcasting list and the pro- 
gram content, and to confirm whether or not program 
broadcasting is correct. 

Next, the display method for displaying the content 
35 of the program broadcasting list and the content of the 
program material in association with each other, partic- 
ularly the display method which can confirm the program 
material scheduled to be broadcasted in succession to 
the program material which is being broadcasted, will 
40 be explained with reference to Fig. 1 . 

Fig. 1 shows an example of the screen display of 
the display device 7 which displays the content of the 
program broadcasting list and the content of the pro- 
gram material in association with each other, according 
45 to the present invention. In Fig. 1 , reference numeral 20 
denotes the display area for displaying a part of the pro- 
gram broadcasting list, reference numeral 21 denotes 
the display area for displaying the representative still im- 
ages for each program material of the program gather- 
50 jng scheduled to be broadcasted (next gathering) in suc- 
cession to the program gathering to which the program 
material which is now on the air belongs, and reference 
numeral 22 denotes the broadcasting time display of the 
present broadcasting. 
55 in the display area 20, the gathering time, the gath- 
ering sequence, the gathering ID, the program time, the 
material number, the program sponsor and the program 
content are aligned and displayed altogether for each 
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gathering and for each program material. Making 23 is 
applied to the. program material which is now on the air 
as shown in Fig. 1 , and represents that the program ma- 
terial is on the air. 

In the display area 21 , on the other hand, the gath- 
ering ID 24 and the group 25 of the representative still 
images of the program material of the next gathering de- 
scribed above are displayed. A text display is added to 
each representative still image. For example, the mate- 
rial number 27, the program sponsor 28 and the pro- 
gram content 29 which constitute the text display are 
displayed for the still image 26. 

To display the images of Fig. 1, the controller 6 
reads out the material numbers of all the programs of 
the next program gathering to the program gathering 
which is on the air at present and the representative im- 
age numbers of the material numbers from the input in- 
formation 10 in the program broadcasting list. The con- 
troller 6 makes the access to the data file of the material 
numbers so read out from the data file stored in the 
memory 8, reads out the program representative still im- 
ages corresponding to the representative image num- 
bers, and holds them in the memory of the controller 6. 
The program representative still images corresponding 
to the representative image numbers of all the programs 
of the next program gathering are read out from the 
memory of the controller 6 and are displayed as the 
screen 21 in Fig. 1 on the display device 7. 

The operator can check in advance the content of 
the broadcasting program of the next gathering by mon- 
itoring the display screen shown in Fig. 1 . Therefore, 
when the operator comes to realize any error of the pro- 
gram material or disturbance of image quality before 
broadcasting of the program by monitoring the display 
screen of Fig. 1, the operator can take emergency 
measures such as the display of a character message 
reading "Please wait for a while" or emergency images 
that are prepared beforehand. 

Because the program content of the next gathering 
is displayed during broadcasting according to the ar- 
rangement described above, a unified tape becomes 
unnecessary. Even when counter-measures for an 
emergent program change depends on the preview of 
the program material scheduled to be broadcasted next 
in succession to the program material which is now on- 
air, an appropriate measure can be decided quickly. 

Next, the display method which can extremely eas- 
ily preview the content of the program material by dis- 
playing altogether the still images representative of the 
image content of each scene for each program material 
in the sequence of the scenes will be explained with ref- 
erence to Fig. 2. 

Fig. 2 shows an example of the screen display of 
the display device 7 which displays the content of the 
program material according to the present invention. In 
this drawing, reference numeral 40 denotes a text infor- 
mation display relating with the program material, and 
the material number of the selected program material, 



the program sponsor and the program content are dis- 
played. These information are read out from the memory 
device 8 under the control of the controller 6 and are 
outputted to, and displayed by, the display device 7. 

5 Reference numeral 41 denotes a display area for 

displaying the still images representative of each scene 
of the program material. In this display area 41 , the still 
images of the selected program material are read out in 
the same way as described above and are displayed. In 

10 the example shown in the drawing, the still images are 
serially aligned from the left to the right in accordance 
with the scene sequence such as the still image 42 cor- 
responding to the first scene and displayed at the up- 
permost left position and then the still image 43 corre- 

15 sponding to the second scene. Six still images are dis- 
played on one row or stage in this example and when 
the still images in one row become full, the next still im- 
age is displayed at the extreme left position of the next 
stage below the former. One to a predeterminedTiumber 

20 of still images can be displayed in the display area 41 , 
and maximum twenty -four still images can be displayed 
in the example shown in Fig. 2. Incidentally, the number 
of still images displayed is different depending on the 
number of the scene for each program material. In Fig. 

25 2, ten images from the still image 42 to the still image 
44 are displayed. 

Incidentally, the still image 43 is displayed as the 
display example when it is set as the representative still 
image representative of the program material, and its 

so image is marked by a thick frame. 

The program materials have naturally different 
scenes and in many cases, have similar scenes and en- 
tirely the same scene. Therefore, when the program ma- 
terial is stored in the video server, etc, the preview of 

35 the content of the program material can be made ex- 
tremely easily by displaying altogether the still images 
representing the image content of each scene for each 
program material in the scene sequence. 

The external input information on the material con- 

40 tent recorded in the video server 5 are read out from the 
recording device 8 and are displayed as shown in Fig. 
8. In this drawing, reference numeral 1 00 denotes a dis- 
play area for displaying a part of the external input in- 
formation. In this display area 1 00, the material number, 

45 the program sponsor, the program content and the pro- 
gram time are displayed in the list form. To switch the 
screen to the representative image of one program ma- 
terial, display portion of the program material whose 
content is desired to be previewed is selected by ma- 

50 nipulating the mouse or the keyboard from among the 
external input information displayed in the display area 
100. Subsequently, when the button 85 of "registration" 
in the screen of Fig. 8 is selected by the operation of the 
mouse or the keyboard, the still image is displayed in 

55 the display area 41 for displaying the still image repre- 
sentative of each scene of the program material in Fig. 
2. The still images 42 to 44 representative of each scene 
of the program material is displayed when the controller 
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6 reads out the material number selected from the ex- 
ternal information 10, finds out the stil! image file having 
the same name as that of the material number from the 
data file of the memory device 8 and outputs the still 
images in the data file to the display device 7. 

As the still images of one program material are dis- 
played in this way as shown in Fig. 2, the content of one 
program material can be promptly previewed when it is 
desired to preview the content of one program material 
or to confirm whether or not the data which manages 
the material corresponds to the material content, without 
the necessity for reproducing the material of the pro- 
gram and watching it in the course of the whole program 
time. 

Next, the display method which can confirm any 
problem of the broadcasting sequence between the pro- 
gram materials by so setting the representative still im- 
ages as to represent one characterizing scene in the im- 
age signals of each program material and aligning and 
displaying the content in accordance with the broadcast- 
ing sequence will be explained with reference to Fig. 3. 

Fig. 3 shows another example of the display which 
displays the content of the program broadcasting list 
and the content of the program material for each gath- 
ering. In the drawing, reference numeral 70 denotes the 
display of the broadcasting date based on the program 
broadcasting list and reference numeral 71 denotes the 
display area for displaying the representative still imag- 
es of each program material in the frame selected gath- 
ering the program broadcasting list. Reference numeral 
72 denotes the program gathering time, reference nu- 
meral 73 denotes the program gathering ID and refer- 
ence numeral 74 denotes the program number in the 
program gathering. 

The representative still images representative of 
each program material of the selected gathering are reg- 
ularly aligned and displayed in the display area 71 in 
accordance with the broadcasting sequence. 

The content of the program broadcasting list is dis- 
played in the list form shown in Fig. 6 at the display step 
1 1 9. In Fig. 6, reference numeral 80 denotes the display 
area for displaying a part of the program list. In this dis- 
play area 80 are displayed the gathering time, the gath- 
ering sequence, the gathering ID, the program time, the 
material number, the program sponsor and the program 
content in the list form for each gathering and for each 
program material. Further, the display screen can be 
switched to the display screen shown in Fig. 3 for pre- 
viewing the program content for each gathering by using 
the still images. This switching method is as follows. 
First, the display portion of the gathering information dis- 
played in the display area 80 of the gathering the content 
of which is desired to be previewed is selected by the 
operation of the mouse or the keyboard. Next, the "rep- 
resentative image screen" button of the screen shown 
in Fig. 6 is selected by the operation of the mouse or the 
keyboard and in this way, the representative still images 
representative of the program material inside the gath- 



ering shown in Fig. 3 are arranged and displayed in ac- 
cordance with the broadcasting sequence. Fig. 3 shows 
the example where the program gathering having the 
gathering sequence of No. 02 and the gathering ID of 

s 060221 23 is selected, and the representative images of 
the five programs inside the gathering are displayed. 
The still images representative of the program materials 
inside the gathering are displayed as the controller 6 
reads the material number and the representative image 

io number of its program material in the broadcasting se- 
quence from the external input information 10, finds out 
the still image file having the same name as that of the 
material number from the information inside the memory 
device 8, reads the still image of the representative im- 

15 age number and outputs it to the display device 7. When 
the screen shown in Fig. 3 is displayed in this way, 
whether or not any problem of the broadcasting se- 
quence of the program material exists can be quickly 
previewed. Here, the term "problem of the broadcasting 

20 sequence" means an inappropriate broadcasting se- 
quence such as casting of the advertisement of food- 
stuffs after casting of the advertisement of toilet chemi- 
cals, casting of the advertisement of a wedding hall after 
casting of the advertisement of a cemetery park, etc. 

25 By the way, the representative still image described 
above is generated when the controller 6 sets one still 
image for each program material from among the still 
images for each scene as a representative still image 
representative of each program material. This set oper- 

30 ation sets the still image representative of the first scene 
as the representative still image of the program material 
at the time of the scene detection, for example. Further, 
the operator can select and set in addition another still 
image representative of the program material by apply- 

35 ing the instruction from the keyboard 11 or from the 
pointer moving on the display screen shown in Fig. 3. 

In the case of the example shown in Fig. 3, the rep- 
resentative still image 75 of the program material first 
broadcasted is displayed at the uppermost left position 

40 in the display area 71 , and the next representative still 
image is displayed on the right side adjacent to the 
former in accordance with the broadcasting sequence. 
When the upper stage is filled, the next representative 
still image et seq are similarly aligned and displayed 

45 from the extreme left position of the next stage. 

The text display is added to each representative still 
image so that the content of each program material can 
be grasped more easily. For example, the program 
sponsor 76, the program content 77, the material 

50 number 78 and the program time 79 which constituted 
the text display are displayed for the representative still 
image 75. 

According to the display method described above, 
the representative still image is so set as to express the 
55 content of one characterizing scene among the image 
signals for each program material, and these represent- 
ative still images are aligned and displayed in accord- 
ance with the broadcasting sequence. In this way, any 
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problem of broadcasting in the broadcasting sequence 
among the program materials can be previewed. At the 
same time, there is the case where the program mate- 
rials listed up in the broadcasting sequence information 
and inputted to the video server 5 cannot be used be- s 
cause the images contain the noise. Although such ma- 
terials must not be kept storing to the video server 5, the 
operator is likely to forget to take away such materials 
in an emergency. When pre-viewing is made by using 
the still image representative of the program even in 10 
such a case, pre-viewing can be made extremely easily 
because the boundary between noisy portion and nor- 
mal image portion is detected as a scene change and 
the representative still image of noisy portion is dis- 
played for example spots or fully dark. *5 

Next, the display method which can preview the 
problem when the broadcasting sequence becomes the 
problem by the comparison of one scene with another 
or when the problem of the broadcasting sequence be- 
comes the problem depending on the content of the 20 
scenes not set as the representative image and not rep- 
resenting the subject matter of the program material will 
be explained with reference to Fig. 4. 

Fig. 4 shows another example of the screen display 
of the display device 7 which displays the content of the 25 
program broadcasting list and the content of the pro- 
gram material for each program gathering according to 
the present invention. In Fig. 4, reference numerals 50, 
51 and 52 indicate program gathering time, program 
gathering ID and number of programs in the program 30 
gathering, respectively. 

Reference numeral 53 denotes the text information 
display relating to the program material which is first 
broadcasted in that program gathering, and the material 
number of the program material, the program sponsor, 35 
the program content and the material length are dis- 
played. Reference numerals 54, 55 and 56 denote the 
text information displays relating to the program mate- 
rials similarly broadcasted in the second, third and fourth 
places, respectively. 40 

A series of the still images 57-1 to 57-10 corre- 
sponding to the program material are displayed below 
. the text display of each program material such as the 
text display 53. Similarly, the still images 58-1 to 58-10, 
the still images 59-1 to 59-10 and the still images 60-1 45 
to 60-10 are displayed below the text displays 54, 55 
and 56, respectively. 

The operation of the still image display inside the 
program gathering of the program broadcasting list will 
be explained in further detail. The content of the pro- so 
gram broadcasting is displayed in the list form as shown 
in Fig. 6. Here, the display can be switched to the display 
for previewing the content of the program for each pro- 
gram gathering by using the still image. To switch the 
display in this instance, the display portion of the pro- ss 
gram gathering information displayed in the display area 
1 1 0 of the program gathering the content of which is de- 
sired to previewed is selected by operating the mouse 
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or keyboard. The still images of the program materials 
inside the program gathering shown in Fig. 4 are dis- 
played in accordance with the broadcasting sequence 
when the "cut list" button 84 of the screen shown in Fig. 
6 is selected by operating the mouse or the keyboard. 
The still image of the program material inside the pro- 
gram gathering is displayed when the controller 6 reads 
the material number in the broadcasting sequence in- 
side the selected program gathering, finds out the still 
image file having the same name as that of the material 
number from the information preserved by the memory 
device 8, reads the still image having the representative 
image number and outputs it to the display device 7. 
When Fig. 4 is displayed in this way, the problem of the 
broadcasting sequence of the program material, if any 
can be reliably previewed. The problem of the broad- 
casting sequence of the program material can be quickly 
previewed by the still image representative of the pro- 
gram of Fig. 3. If the program is doubted as beifig inap- 
propriate for broadcasting if it is continuously broadcast- 
ed in this instance, previewing is effected by displaying 
the still images aligned in the broadcasting sequence. 
Since all the still images of the scenes in the program 
are displayed in this way, whether or not the program is 
suitable for broadcasting can be precisely judged. In the 
case of commercial messages, for example, because 
all the still images of the scenes in the program are dis- 
played, even the commercial messages having the 
broadcasting sequences which should be avoided as 
much as possible, such as the case where a commercial 
message to be next broadcasted uses the same back- 
ground or the same personality as that of the preceding 
commercial passage can be previewed, too. 

When the display of all the program materials inside 
the program gathering cannot be made in one screen, 
the display can be switched. For example, the display 
can be switched by pointing a "before" button display 61 
or an "after" button display 62 displayed in the screen 
by the pointer (not shown). 

Next, the display method which can preview the 
content of the program to confirm as to whether or not 
the program material may be broadcasted immediately 
before broadcasting by displaying at the portion of the 
still image display 26 of the next program gathering ex- 
plained with reference to Fig. 1 not only by the still im- 
ages but also by moving images having the same image 
size as that of the still image (hereinafter called the "re- 
duced moving images") will be explained with reference 
to Fig. 6. 

In the program broadcasting system according to 
the present invention shown in Fig. 5, the program ma- 
terial recorded on the video tape is reproduced by the 
VTR 1 to 3. The image signals so reproduced are input- 
ted to the video server 5 and to the controller 6. The 
controller 6 stores the inputted video signals as sets of 
a plurality of continuous still images (frame images) in 
the memory device 8. In this instance, each still image 
is thinned out and compressed, for example, and is 
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stored after the information quantity is decreased. At the 
same time, the scene change point is detected by using 
the technology disclosed in JP-A-4-111181 , tor exam- 
ple, and the still image number of the image relative to 
the detected scene change point is stored. 

In this way, the information necessary for broad- 
casting one program material is stored. Next, the meth- 
od of displaying the reduced moving images stored in 
this way will be explained. 

When a certain program is changed immediately 
before broadcasting, confirmation of the program mate- 
rial inputted to the video server immediately before 
broadcasting or confirmation as to whether or not the 
commercial message is suitable for the program which 
is now on the air is made by confirming the program ma- 
terial to be broadcasted in the next program gathering 
while the program name now on the air is displayed and 
the present broadcasting state is confirmed, because 
there is no time to make the confirmation by switching 
the screen to the one shown in Fig. 3 or 4. In the case 
of the still images representative of the program shown 
in Fig. 1 , all the contents of the program cannot be 
watched. Therefore, the typical image screen of the next 
program gathering shown in Fig. 1 is displayed by the 
moving images to confirm the program content. 

In the system using the method of recording mate- 
rial data of broadcasting programs and displaying the 
content, a recording medium is provided to storing the 
procedure for implementing the method therein. The re- 
cording medium storing the procedure may be realized 
by various kinds of forms for example tapes, disks and 
semiconductor chips. 

The content of the program broadcasting list which 
shows the program broadcasted from the video server 
5 is displayed as shown in Fig. 6. In Fig. 6, reference 
numeral 80 denotes the display area which displays the 
program name, which is now on the air, among the pro- 
gram list. Since the program name broadcasted from the 
video server 5 is displayed in the display area 80, the 
progress of the present broadcasting can be grasped at 
a look. To preview the program material of the next pro- 
gram gathering, the screen can be switched to the rep- 
resentative image by selecting the "representative im- 
age screen" button of the screen shown in Fig. 6 by op- 
erating the mouse or the keyboard. At this time, the rep- 
resentative image screen display area 21 shown in Fig. 
1 is displayed. The representative image of the next pro- 
gram gathering is displayed when the controller 6 reads 
out the material number of the next program gathering 
to the program gathering now on the air and the repre- 
sentative image number of the program material from 
the input information 10, finds out the still image data 
file having the same number as the material number, 
and reads the still images of the representative image 
number. 

The reduced moving image display method selects 
the display portion 1 20 of the program material which is 
desired to be reproduced by the moving image from the 



representative image display area 21 in Fig. 1 by oper- 
ating the mouse or the keyboard. Thereafter, the "re- 
duced moving image reproduction" button 1 21 is select- 
ed by operating the mouse or the keyboard, and the re- 

5 duced image is reproduced in the representative image 
display portion 1 20 of the next program gathering shown 
in Fig. 1 . Reproduction of the reduced image is carried 
out by reading the material number of the selected pro- 
gram material from the input information 10, finding out 

10 the still image data file having the same name as that of 
the material number, reading the still images of the data 
file into the controller 6 and continuously displaying 
them. 

According to the present invention, the still images 

is representative of the image content of each scene can 
be displayed for each program material in the sequence 
of the scenes in the list form, and the series of repre- 
sentative still images representative of each program 
material and the series of still images or movincfimages 

20 aligned in the sequence of the scenes can be displayed 
in the list form in accordance with the integrated broad- 
casting sequence information, and confirmation of the 
broadcasting sequence information can be made effi- 
ciently. Therefore, it becomes unnecessary to produce 

25 the unified tape, and the troubles of producing the uni- 
fied tape and confirming the broadcasting sequence, the 
program content and image quality of the tape by repro- 
ducing the unified tape become unnecessary. 

According to the present invention, further, the rep- 

30 resentative still images of the next frame to the frame to 
which the program now on the air belongs can be dis- 
played in the list form during broadcasting of the pro- 
gram, and a counter-measure can be taken quickly and 
appropriately for an emergent change of the program. 

35 

Claims 

1 . A method of recording material data of a broadcast- 
40 jng program and displaying its content, comprising: 

steps (104 to 108) of storing data of a plurality 
of program materials each having an identifica- 
tion code allotted thereto in a first memory de- 
45 vice (5); 

steps (1 1 0 to 1 1 3) of extracting one or a plurality 
of image data representative of said program 
material from each of said program materials; 
a step (1 1 4) of arranging data of said represent- 
so ative images of each of said program materials 
in association with said identification code in 
the sequence of a broadcasting, and storing 
said data in a second memory device (8); and 
a step (1 1 9) of reading out the data of said rep- 
55 resentative image of said program materials 
from said second memory device (8) on the ba- 
sis of said identification code, and displaying 
said data on a display device. 
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2. A method according to claim 1, wherein said step 
of extracting the data of said representative image 
includes a step (110) of the change of a scene in 
said program material, and a step (111) of deciding 
still images relating to one or a plurality of frames $ 
in which the scene changes, as the images repre- 
sentative of said scene. 

3. A method according to claim 2, wherein one of said 
still images relating to a plurality of frames in which 10 
the scene changes is decided as an image (26, 43, 

75) representative of said program material. 

4. A method according to claim 3, wherein the still im- 
age of the first frame among the still images relating * 5 
to a plurality of frames in which the scene changes, 

is decided as an image representative of said pro- 
gram material. 

5. A method according to claim 3, which further com- 20 
prises a step (1 1 7) of changing the image represent- 
ative of said program material decided to a still im- 
age of another frame (Fig. 8). 

6. A method according to claim 5, wherein said images 25 
(75) representative of said program material decid- 
ed are displayed for each of said program materials 

in accordance with the broadcasting time of said 
program at said display step (Fig. 3). 

30 

7. A method according to claim 2, wherein said images 
(42, 43, 44) representative of said scenes of said 
program material are displayed (41 ) at the time se- 
quence of broadcasting of said program at said dis- 
play step (Fig. 2). 55 

8. A method according to claim 3, wherein a plurality 
of images representative of said scene are dis- 
played (41) in accordance with the time sequence 

of broadcasting of said program at said display step, 40 
and an image (43) representative of said program 
material among a plurality of said images is dis-. 
played (Fig. 2) in such a manner that it can be dis- 
tinguished from other images (42, 44). 

45 

9. A method according to claim 2, wherein the images 
(57-1, 58-1, 59-1, 60-1) representative of said 
scenes of said program materials are displayed in 
the time sequence of broadcasting of said programs 

for all of said program materials of a plurality of said 50 
programs to be continuously broadcasted at said 
display step (Fig. 4). 

10. A method according to any of claims 6 through 9, 
wherein information (20, 40, 76 to 79, 53 to 56) on 55 
said program corresponding to said displayed im- 
ages are displayed with said images at said display 
step (Fig. 1, Fig. 2, Fig. 3, Fig. 4). 
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11. A method according to claim 11, wherein the data 
of said representative image is a dynamic image 
generated by suitably thinning out image data of 
said program material (Fig. 1). 

12. A method according to claim 1 , which further com- 
prises a step of reading out said program material 
from said first memory device (5) in accordance with 
said time sequence of broadcasting and outputting 
said program material. 

13. A system for recording materials of a broadcasting 
program and displaying its content, comprising: 

recording apparatuses (1, 2, 3) for recording 
said broadcasting program materials; 
input means (10) for inputting information on 
broadcasting programs including information of 
a broadcasting time of each program iftto said 
control means; 

control means (6) for processing said informa- 
tion inputted in accordance with a control pro- 
gram, and controlling the operation of said sys- 
tem as a whole; 

a display (7) for displaying the data outputted 
from said control means on a screen; 
a first memory device (5) for storing image data 
read out from said recording apparatuses; 
a second memory device (8) coupled with said 
control means for storing data including said in- 
formation of said broadcasting time outputted 
from said control means; and 
a broadcasting output means (1 2) for outputting 
said image data from said first memory device; 
wherein said control means (6) includes means 
for allotting identification codes to a plurality of 
program materials, and means for extracting 
the data of representative images of each pro- 
gram material from the image data of said pro- 
gram materials for each program material, and 
said control means (6) outputs the data of the 
representative images of each of said program 
materials in association with said identification 
code to said second memory device, reads out 
the data of said representative image of said 
program material on the basis of said identifi- 
cation code from said second memory device, 
outputs said representative image to said dis- 
play (7), and controls said first memory device 
(5) to output said image data. 

14. A recording medium for storing a procedure for im- 
plementing said method of recording material data 
of broadcasting programs and displaying the con- 
tent according to claim 1 . 
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